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ABSTRACT 

Requests for evaluation instruments measuring program 
quality rather than program content have required the development of 
new measuring procedures. Two sets of materials are presented in this 
report — the first to identify objectives and expected outcomes for^ 
school programs and persons in the school, and the second to identify 
the actual climate and learning opportunities provided by the school 
and the resultant school and student growth. Forms in Set I are: (1) 
Form for Relating Mission to School program; (2) Form for Relating 
Objectives to Outcomes; and (3) Form for Describing Program. Set II 
contains four evaluation instruments: (1) Report of Program Offering; 
(2) Classroom Observation Schedule; (3) Form for Rating Students and 
School on Key Dimensions; and (4) Form for Community Rating. (MB) 
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A. Introduct i- :i 

Over the last six years, school piioj^le have been asking us for vjays to evaluate what 
happens in scliools in an on-going manner. The request focuses on monitoring program 
quality ratht^r than tracking prograKi content. Vrnile the two are related, ti:e perspective 
of quality control suggests target sampling rather than detailed recording. One 
tends to develop procedures to identify the important and different things tliat 
happen, in a school rather than prt^cedures that identify the detail and its complete- 
ness. T(.^ record the important and different requires the development of other 
procedures also that identify tlie context, expectations, goals, and results uhat 
describe the norm. 

Wb.at hiis evolved is an interrelated but distinct set of procedures and materials. 

Set 1 - LdentLfios the ol^jectives and expected outcomes for the programs 

.:in d per s on s 1 n the s ch o o ] 
Set II- identifies the actual climate and learning opportunities provided 

by the school and perceived grov;tli of students and school and 

key dimensions. 

The materials remain in the process of development. They are collected here in 

one place to ])rovide school peopln a sample of a practical way to measure the practice 

of education in a school. 
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B. Set I 

IDKNTIFVI NG OHJFXTIVE S :VND EXPECTED OUTCOMES F OR 

HiOGR;\:-is a:\d persons in the sc hool 

Schools usually have stiatements of philosophy, lists oi; goals and even objectives. 
These tend to be stated in rather general terms. They usually are reviewed and 
a-pproved by the Board and the school faculty on some regular bosis. Accreditation 
procedures usually ask those responsible for preparing the documentation for 
accreditation nnd approval to begin with the school's statement of mission or 
philosophy on a yearly basis. 



The following form marked 



MISSIO>: i is designed to assist individuals as well as 



schools to relate the statement of philosophy, the goals statement or the mission 
statement to their particular job in tlie school or school system. It should be 
accompanied by the actual statement that people arc being asked to e?:amine and 
retatiG to (a sample is attached as Appendix I). 

V.Hiat is important to notice is that besides asking an individual to relate his 
activity to the statement of Mission (question 3), the form also does two other 
important things: (1) it: identifies changes needed in the Mission statement from 
the point of view of people in the organization and (2) it identifies v;hat 
people think is needed and important in the organization to assure that the mission 
is accomplished. Our experience shows that sorting out what needs to be clianged in 
Mission and in Program assures a more targeted understanding of the events that 
occur in the school. 
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The fomi marked 



1 



PKRFORM/O'XE .\NALYSIS CHART 1 provides a v:ay of comparing the 



objectives, outcomer? and factors of influence in an organization. The forms 
assume that the persons working in the school or system have objectives they know 
they are tryinc; to reach. These objectives may be intuitive or written. In 
either case, the purpose of the form is to describe the objective and to detail 
the actual outcomes with regard to that objective with some determination oi 
degree of success in reaching the objective. Poor, fair, adequate, complete 
are terms often used to describe the degree nf success. The Factors of Influence 
Column allows persons to note hoth positive and negative events or decisions 
that influenced performance so tliat the resulting outcomes occurred. 



The form marked 



PROCR/V-I j provides the principal or teacher in particular an 



opportunity to describe the important activities/programs that are on-going in 
support of the Mission or objectives of the school. The purpose of the form is to 
more accurately describe the important activities and events of the school as* seen 
by those who make the school go. It is important to note tliat questions 2 and 3 
provide the opportunity to describe needed improvements. We find these crucial 
in determining the difference l)etween events that need to be changed and events 
that just didn^t work well. 

The examinatioi^ of the information on these forms provides some insiglit into 
what the persons working in the organi;:atinn day by day see the actual Mission, 
programs and ob.]ectives to be. The actual practice of people in the school tends 
to be described more realistically as they perceive it in an interrelated manner. 
\'J\\at actually happens is that the important and the different or in need of change 
are quickly identified. The normal is left assumed or unexamined. 
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TABLE I 

FORM FOR RELATING MISSION^ TO SCHOOL PROGRAM 
Name Assignment Date 



MISSION 



1. Are you aware of the Mission Statement for the School? yes no 

2. vrnat changes would you make in the MISSION STATEMENT? 



3. What are three things you have done to help the school work toward this Mission: 
(a) 



(b) 



(c) 



4. \^^at are the three most important things in the school program that help it 
accomplish its Mission? 

Rating 

(a) poor fair good excellent 



poor fair good excellent 



(c) poor fair good excellent 



\iJhat needs to be added to the school program to help it more effectively reach 
its Mission? 



3. What are three things you have done to help the school work toward this Mission: 



(a) 



(fa) 



(c) 



4. ;%liat are the three most important things in the school prograrr. chat help it 
accomplish its Mission? 

Rat ing 

(^) poor fair good excellent 



(b) 



poor fair good excellent 



poor fair good excellent 



3. \-Jhat needs to be added to the school program -to help it r^ore effectively reach 
its Mission? 

(a) 



(b) 
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TABLE III 
FORM FOR DESCRIBING PROGRiVM 



Name 



Assignment 



Date 



PROGRAM 



1. K^nat are the THREE major activities you have undertaken or vere involved in to 
help students learn or the school operate this year? 



Effect 



(a) 



0V7 

0 1 2 



3 4 5 



Cb) 



0 12 3 



(c) _ 



0 1 



3 4 5 



2. UTiat are TWO activities or programs the school should undertake to make things 
better for students next year: 

(a) 



(b) 



3. What are TWO activities or programs the school should provide to make things 
better for teachers next year? 



(a) 



(b) 



ERIC 



0 1 2 3 4 5 



(c) 



2, U^at are TWO activities or programs the school should undertake to make things 
better for students next year: 

(a) 



(b) 



3. \'Jhat ate TWO activities or programs the school should provide to make things 
better for teachers next year? 

(a) 



(b) 



4. What factors had the greatest influence on student achievement this past year? 
positive negative 



5. \<!hat factors had the greatest influence on your performance this past year? 
positive negative 
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C. Set 11 

IDEXTIFYING ACTUAL CLIM.\T£ AA'D LEARNING OPPORTUNITIES 
j^KOVlDEO BY A SCHOOL AXD PE RCEIVED GROWTH 

OF STUDENTS ;\:-:d school on key dimensions 

Schools nornaLlv con^plete scne kind of self evaluation procedure during their 
e:-:istence. In a fev Lnstanc:es, school and personnel appraisal .-systems are 
sciieduled on a regular yearly basis. In ir.ost instances, observation forms focus 
on the detail of classroom, the interaction between teacher and pupil, and the . 
evidence of teaclier performnncc of a certain technique. These materials focus 
ratzher on general climate and learning opportunities provided instead. As a result, 
tihey do not tie a causal relation betv;een technique and student learning; they 
describe what is observed or perceived to occur. The i^uram^ Off er in^ Report 
provides some control for tlie general progran proposed. The Classro om Obst=rvation 
Report describes climate, observed behavior and observed practices. By completing 
the Classroom Observation Report at least every four months, one can identify the 
trends in actual practices in the classroom. 

Learning; opportunities often turn out to be those teachers plan (see Program Offering 
Report) and those actually practiced (see the Classroom Observation Report). One 
should limit observations drawn by comparing the information on these two reports 
and any others. Of more importance is the documentation over tim.e of the trends 
of planned activity and actual performance. 

Impact of classroom, practice on students and the school is doccimented by the key 
dimensions form. It is important to note that items listed under key dimensions in 
any of the three questions should be those that apply actually to the school. 
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One should review the earlier context setting forms on program mission and 
objectives to include on the list all that apply. In Question 3, in particular, 
appropriate programs need to be identified. 

We have also found that collecting information from the community about program is 
often neglected. In many instances, structured response ' from parents is useful 
in identifying areas of need, concern, confusion or neglect from the perspective 
of the community and parents. 
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TABLE V 

CLASSROOM OBSERVATION SCHEDULE 
Date Time 



Observer Teacher 



1. OBSERVED CLIMATE (circle as many as apply) 



EKLC 



boring 

irrelevant 

unnecessary 



difficult 

open 

usable 



dull 

provocative 
other 



helpful 
relevant 



informative 
responsive 



insightful 
stimulating 



2. OBSERVED BEHAVIORS (circle as many as apply) 
(a) TEACHER T^- 



adaptable alert 

disorganized dull 

inflexible . kindly 

responsive stimulating 

other 

(b) STUDENTS ARE: 



alert 
involved 



apathetic 
obstructive 



aloof 
evasive 
original 
systematic 



confident 
open 



apathetic 
excitable 
partial 
uncertain 



attractive 

fair 

poised 



confident 
harsh 

responsible 



understanding unimpressive 



dependent 
responsible 



(c) mAT IS BEING LEARNED: 
application nrtitude (Concept 
3. OBSERVED PRACTICED (circle as many as apply) 

(a) 



material 



excitable 
uncertain 



rocess 



initiating 
other 



other 



(a) Individua - ired 
instructi - 

(b) computer ^.ssisted 
insuruction 

(c) programmed 
instruction 



(d) educational 
televis:i on 



(e) non-grac_ji c: jhool 
approach 



teacher led class 
discussions 



(b) teacher-pupil coop- 
erative planning 

(c) ' small group dis- 

cussions 



(d) individual projects 



(e) performance 
contracting 



(a) tests and measure- 
menus techniques 

(b) group dynamics J 
techniques f: 

(c) techniques for di:a:g-: 
nosing student 
reading programs 

(d) techniques for 
dealing with stur 
deni:s^ cultural 
differences 

(e) techniques for inte- 
grating social, 
issues into 
curriculum 



(f) tutorial programs 
Cg) alternative education (g) work-study programs 



(f) open school 
concept 



(f) discovery learning -l 
procedures ! 

(g) techniques for ob- j 
sprvin<y a nd rec or- 



(a) TEACHER IS: 



adaptable alert aloof apathetic 

disorganized dull evasive excitable 

inflexible kindly original partial 

responsive stimulating systematic uncertain 
other 



(b) STUDENTS ARE: 



alert 
involved 



apathetic 
obstructive 



confident 
open 



dependent 
responsible 



attractive 

fair 

poised 

understanding 



excitable 
uncertain 



confident 
harsh 

responsible 
unimpressive 



Initiating 
other 



(c) mAT IS BEING LEARNED: 
application attitude 
3. OBSERVED PRACTICES (circle 

(a) individualized 
instruction 

(b) computer assisted 
instruction 

(c) programmed 
instruction 



(d) educational 
television 



(e) non-graded sch^ 
approach 



' f ) open school 
concept 

(:;) alternative er 
programs 



concept material 

as many as apply) 

(a) teacher led class 
discussions 

teacher-pupil coop- 
erative planninf^ 

(c) small group dis- 
cussions 

(d) individual projects 



(e) performance 
contracting 



(f) tutorial programs 



(g) work-study programs 



(h) utilization of L-i:!,^c--n-r 
aide in the (iLri~~'rorr. 

(i) learning centers* 



(j) flexible schedules 



(h) activities which 
foster creativity 

(i) other 



( j ) other 



process 



other 



(a) tests and measure- 
ments techniques 

(b) group dynamics 
techniques 

(c) techniques for diag 
nosing student 
reading programs 

(d) techniques for 
dealing with stur 
dents^ cultural 
differences 

(e) techn-tques for inte 
grating social 
issues into 
curriculum 

(f) discovery leamimg 
procedures 

(g) techniques for ob- 
serving and recor- 
ding student be- 
havior 

(h) use of behavioral 
obj ectives 

(1) marking and evalua- 
ting pupil work 

(j) establishing goals 
or objectives in 
terms of student 
behavior 



(k) other 



(k) otlier 



(k) other 
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TABLE VI 

FORiMS FOR RATING STUDENTS AND SCHOOL ON KEY DIMENSIONS 
Person Rating Date ^ 



1. Rate student growth in the following: 



Key Dimensions Rating 



reading 




■ little 


some 


enough 


much 


niath 




little 


some 


enough 


much 


science 




little 


some 


enough 


much 


social studies 




little 


some 


enough 


much 


foreign language 




lit tie 


some 


enough 


mu ch 


ethnic heritage 




lit tie 


some 


enough 


much 


self discipline 




little 


some 


enough 


much 


interest 




little 


some 


enough 


much 


involvement 




little 


some 


enough 


much 


creativity 




little 


some 


enough 


much 


respect 




little 


some 


enough 


much 


other 




little 


some 


enough 


much 


other 




little 


some 


enough 


much 


Rate school growth 


in 


the followi: ; 








Key Dimensions 






Rating 




discipline 




little 


some 


enough 


much 


school spirit 




little 


some 


enough 


much 


art 




little 


some 


enough 


much 


music 




little 


some 


enough 


much 


physical education 




little 


some 


enough 


much 


reading .programs 




little 


some 


enough 


much 


cultural programs 




little 


some 


enough 


"much 


community involvement 


little 


some 


enough 


much 


other 




little 


some 


enough 


much 


other 




little 


some 


enough 


much 


Rate grov/th on key 


programs : 








Programs 








Rating 




a) 




little 


some 


enough 


mu ch 


b) 




little 


some 


enough 


much 



c) . little rJome • enough much 
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d) little some enough much 
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TABLE VII 
FORMS FOR COMMUNITY RATING 

PARENTS AND COMMUNITY SURVEY DATE 

Since the West End School is a commun: ty school, this piece of paper gives 

you as a parent or as a member of the community a chance to tell the Board 

and the School Director what you think about the school. The answers you 

give and the suggestions you make will help West End better serve you. 



1. WHAT I THINK ABOUT \'^ST END SCHOOL NOW (circle any word that applies) 



adaptable 


disorganized 


organized 


alive 


dull 


relevant 


attractive 


efficient 


stimulating 


autocratic 


flexible 


sys tematic 


boring 


friendly 


uncertain 


bright 


helpful 


unimpressive 


busy 


inflexible 


unnecessary 


confused 


inviting 


valuable 


democratic 


LrrelevatLt 




Comments : 







2. GENERAL RATINGS (circle only cr:o on each line) 



a. 


Board 


bad 


poor 


fair 


good 


excellent 


b. 


School Director 


bad 


poor 


fair 


good 


excellent 


c . 


School Program for Youngsters 


bad 


poor 


fair 


good 


excellent 


d. 


School Staff 


bad 


poor 


fair 


good 


excellent 


e . 


Community Involvement 


bad 


poor 


fair 


good 


excellent 


f . 


Programs for Adults 


bad 


poor 


fair 


good 


excellent 



3. SUGGESTIONS I WOULD MAKE ABOUT WEST END SCHOOL 
about the program for y'^iingsters 



about the -program for adults 



about the decision-making process 



mkT I THINK ABOUT WEST END SCHOOL NOW (circle any word that applies) 



ad apt able 


disorganized 


organized 


ali Vu-' 


dull 


relevant 


CL L. 1- U \^ L. ^ V 


pffin* Pn t* 


S t* 1 TTin 1 a t* 1 n {> 


autocratic 


flexible 


systematic 


boring 


friendly 


uncertain 


brigh t 


helpful 


11 n iiTiD r e Q i VP 


busy 


inflexible 


unnecessary 


confused 


inviting 


valuable 


democratir 


irrelevant 




Conunents : 







GENERAL RATINGS (circle only one on each line) 



a. 


Board 


bad 


poor 


fair 


good 


excellent 


b. 


School Director 


bad 


poor 


fair 


good 


excellent 


c . 


School Prograrn for Youngsters 


bad 


poor 


fair 


good 


excellent 


d. 


School StaEf 


bad 


poor 


fair 


good 


excellent 


e. 


Coimunitiy Involvement 


bad 


poor 


fair 


good 


excellent 


f . 


Programs: for Adults 


bad 


poor 


fair 


good 


excellent 



SUGGESTIONS I v::3ULD MAKE ABOUT WEST END SCHOOL 



about the program for youngsters 



about the program for adults 



about the decis ion— making process 



about star:: 



other 



20 



-15- 



D. Conclusion 

Much remains to be done to validate the recording of practice as it is v/ith 
simple tools which focus evaluation, not on application to learn v heory, 
but on implGmentntion of a misr^ion or tm-o ::: loarnii-i^;. The di )1 

.• 1 V- r-M->-,» practice is crucial to more controlled and systematic application 
of coherent learning theory. The identification of the iirnortant and significant 
program events and the classroom behaviors and clLmate c; - lead to more accurate 
c.^: CGXtual description which can assist in the responsiblj^ supervision of persons 
c .rected to accomplish school mission and programs. 
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APPENDTK I 



Mah-Sos School 



MISSION STATE>[ENT 



The Tobique Board of Education sees the Mah-Sos School c.s the focus for 
education programs for the Reserve. The Board looks to the school as the 
meeting place for the Reserve's past and its future. There the young are 
educated in the rich heritage of the Maliseet Indians. There the old share 
their wisdom and experience to continue the traditions of the Maliseet 
Indians. 

Recognizing that people are the most important resource in society, the 
Tobique Band wishes to insure that each person on the Reserve is given the 
opportunity to develop their potential to the fullest extent possible. 
It is the major objective of the school to prepare Indian children to live 
on the Reserve or elsewhere with competence and productivity and to provide 
all ages with education programs to meet their needs. 

The Tobique Band sees that tomorrow's decisions require vision and fortitude. 
The community expects the school to serve as the center for developing the 
Maliseet heritage using all available resources. 



Tobique Board of Educcition 
(Spring 1975) 
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